Early endpoints for acute bacterial skin and skin structure infections.

In this issue of the journal, Friedland et al. (4) present a retrospective analysis of the two CANVAS trials (3), employing the newer endpoints from the U.S. Food and Drug Administration (FDA) (7). First, they are to be congratulated for having the foresight to include sufficient measurements in their trial to allow the reanalysis even prior to the issuance of the new guidelines. The analysis employing the earlier endpoint was overall concordant with the analyses using the traditional test-of-cure endpoint. Both showed that when data from both trials were pooled, the results demonstrated ceftaroline to be significantly better than the combination of vancomycin plus aztreonam. Individually, one of the trials demonstrated significantly better effect, but the second trial did not, preventing an outright claim of superiority. While the reanalysis was important to see, there are, I believe, other issues as important as or more important than the analysis per se. These have to do with the new FDA guidelines for acute bacterial skin and skin structure infections (ABSSSI). (i) Clearly, the speed with which improvement takes place may be an important issue. However, equally important is whether the patient remains in the “cure” category at test of cure (TOC). To this end, it would have been nice to identify any discordances between endpoints for the subset of patients for whom both endpoints were determined. One could imagine that some early responders might fail at TOC. Likewise, given enough time, it is highly likely that patients failing early could still reach cure status at TOC. (ii) Was what was measured the best endpoint? In the paper by Friedland et al. (4), the two early endpoints measured were cessation of infection spread and afebrility at day 3 in a subset of patients with lesion sizes of 75 cm and deep and/or extensive cellulitis, major abscess, or an extensive wound. The first issue is with the choice of fever, as only a minority of patients were febrile at study entry. Impaired subjects, such as the frail elderly, may not be able to mount a febrile response yet may be very seriously ill. The second part of the endpoint was cessation of spread and not some more difficult-to-achieve endpoint such as reduction (by a percent) in involved area. Bhavnani et al. presented an abstract at the 51st Interscience Conference on Antimicrobial Agents and Chemotherapy in 2011 (2) describing the analysis of a phase II study of a new agent for ABSSSI. In this analysis, two groups were contrasted, patients with AUC/MIC ratios (ratios of the area under the concentration-time curve to the MIC) at or above a given breakpoint and those with ratios below that breakpoint. Two endpoints were examined: reduction in area of erythema by different percentages (10 to 70% reduction) at multiple times and this same sort of analysis for swelling (measurements were made daily to day 7). This analysis employed a Kaplan-Meier approach and showed for both endpoints that the greatest value for delta between treatment groups occurred on either day 3 or day 4. Also, the amount of effect showed maximal significance at the 10 to 30% reduction thresholds for both endpoints. This makes clinical sense, as higher degrees of decline in endpoint would occur less frequently. Nonetheless, with two groups with differing exposure to the same drug, it is clear that there is both a time of evaluation and a degree of effect that optimally separates the two groups. This sort of analysis needs to be considered for a contrast between an experimental agent and a control agent so that the most scientifically informative trials can be performed. The important issue (expanded below) is that the endpoints chosen ought to be derived not from historical data from the 1930s but from modern data identified with modern techniques (allowing percent reduction in involvement estimation) and employing modern mathematical approaches. (iii) Perhaps the most important issue is the generation of endpoints from 1937 data sets, as published. The papers by Snodgrass and Anderson (5, 6) were groundbreaking for the time. There are so many issues with these data, however, that it is mind-boggling that they serve not as a springboard to design exploratory analyses with modern data but as the basis on which to generate a guidance document. The FDA has (absolutely correctly) denied approval of the antiMRSA cephalosporin ceftobiprole in recent times because of the inability to verify the source data in a sufficiently high number of patients from the database. Yet the data in the papers by Snodgrass and Anderson are completely nonverifiable. Further, it is highly likely that the endpoint is nondiscriminatory. When one reads the sulfanilamide paper, it is important to realize that 60% of patients had experienced a cessation of lesion spread on day 0 in the sulfanilamide group, while 39% experienced cessation on day 0 in the UV-light control group! Taking out 60% of the population on day 0 markedly diminishes the ability to discriminate the effectiveness of two drugs. Further, the endpoint is cease of infection spread, not regression of the involvement. As Bhavnani et al. demonstrated (2), the difference between groups depends on how much lesion regression is demanded and when the evaluation occurs. Should we not revisit the endpoint based on modern quantitative methodology to identify a required degree of effect and time of evaluation that provides optimal discriminatory power? (iv) Another issue, not so much in the realm of endpoint, is the philosophy behind calculation of a noninferiority (NI) margin. While it is recognized that the estimation of drug effect on the NI margin should probably be somewhat conservative, the issue devolves into whether one wishes to be conservative or straightforwardly biased. The best (most likely to be correct) estimate of the drug effect is the actual difference between groups (drug versus placebo). There are obvious difficulties performing placebo-con-